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ABSTRACT 


An  adaptive  control  system  is  a  system  that  detects  changes  in  the  plant  parameters 
and  makes  necessary  adjustments  to  the  systems  performance.  This  thesis  examines  the 
use  of  parallel  distributed  processing  systems  (neural  networks)  in  adaptive  control.  A 
general  neural  network  structure  is  introduced  and  a  description  of  the  Backpropagation 
paradigm  is  given.  A  discussion  of  adaptive  control  theory  including  the  one  step  ahead 
prediction  control  algorithm  and  the  linear  least  squares  estimation  is  given.  .A  neural 
network  structure  consistent  with  adaptive  control  theory  is  developed  and  tested  by 
simulating  the  lateral  and  directional  motion  of  the  A-4  aircraft.  The  network  output  is 
then  compared  to  the  output  of  the  true  system.  The  purpose  of  this  thesis  is  to  develop 
and  test  a  neural  network  structure  capable  of  performing  the  parameter  estimation  and 
control  functions  of  an  adaptive  controller. 
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1.  INTRODUCTION 


An  effective  control  system  must  be  able  to  adapt  to  factors  that  effect  the  dynamics 
of  the  system  such  as  changes  in  the  operating  environment  or  component  wear  with  time. 
The  control  system  having  a  candid  ability  of  adaptation  (that  is,  the  control  system  itself 
detects  changes  in  the  plant  parameters  and  makes  necessary  adjustments  to  the 
performance)  is  called  the  adaptive  control  system  [Ref.  l:pp.  5].  Previous  research 
described  in  [Ref.  2]  demonstrated  how  adaptive  control  problems  can  be  represented 
using  neural  networks.  The  system  used  to  investigate  the  use  of  neural  networks  for 
estimation  and  control  was  the  longitudinal  motion  of  the  A-4  aircraft. 

This  thesis  will  study  the  use  of  neural  networks  for  estimation  and  control  using 
the  lateral/directional  equations  of  motion  of  the  A-4  aircraft.  Chapter  11  will  discuss 
what  neural  computing  is  and  describe  neural  network  processing.  A  description  of  the 
back-propagation  algorithm  will  also  be  given.  Chapter  111  will  discuss  adaptive  control 
theory  and  the  relationship  between  neural  networks  and  adaptive  control.  Chapter  IV 
will  discuss  the  experimental  setup  including  the  hardware  and  software  used,  a 
description  of  the  lateral/directional  motion  of  the  A-4  aircraft  and  development  of  the 
neural  network  model  used  to  simulate  that  motion.  Chapter  V  includes  the  results  and 
discussion  of  the  simulation  experiment. 
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11.  NEURAL  NETWORK  THEORY 


A.  WHAT  IS  NEURAL  COMPUTING? 

Many  models  have  been  developed  that  try  to  replicate  the  information  processing 
tasks  of  the  human  brain.  The  study  of  neural  computing  involves  the  use  of  computer 
models  to  perform  this  replication  in  a  very  simplified  manner.  These  models,  which  are 
a  form  of  parallel  distributed  processes  (PDP),  are  known  as  neural  networks. 

B.  ANALOGY  TO  THE  BRAIN 

Although  their  methods  of  operation  may  differ  significantly  from  that  of  the  brain, 
all  neural  network  models  can  be  described  through  an  analogy  to  the  components  of  the 
brain  which  they  attempt  to  model.  Figure  1  is  a  model  of  the  basic  building  block  of 
the  human  nervous  system,  (the  neuron).  Its  nucleus  is  a  processing  unit  which  receives 
impulses  from  other  neurons  through  input  paths  called  dendrites.  If  the  input  signal  is 
strong  enough,  the  neuron  is  activated,  and  an  output  signal  is  generated.  This  output 
signal  is  transmitted  through  paths  called  axons.  The  axon  splits  into  multiple  paths 
which  connect  to  the  dendrites  of  other  neurons  through  junctions  called  synapses.  These 
junctions  are  chemical  in  nature.  The  magnitude  of  the  signal  transferred  depends  on  the 
amount  of  chemicals  released  by  the  axons  and  received  by  the  dendrites.  This  synaptic 
efficiency  or  strength  is  what  is  modified  when  the  brain  leams.  The  synapse  combined 
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with  the  processing  of  information  in  the  neuron  form  the  basic  memory  mechanism  of 


the  brain.  [Ref.  3:pp.  3-4] 


Figure  1:  Basic  Building  Block  of  the  Nervous  System  [Ref.  3] 


C.  WHAT  IS  A  NEURAL  NETWORK? 

The  basic  components  of  a  parallel  distributed  processing  system  (ie.,  a  neural 
network),  are  shown  in  Figure  2.  Each  circle  represents  a  processing  unit  with  an 
activation  value  a(t).  This  activation  is  processed  by  an  activation  function  w'hich 
produces  an  output  o(t).  Each  output  passes  along  a  connection  which  passes  on  that 
output  to  other  processing  elements  much  the  same  way  as  the  axons  do  to  dendrites  in 
the  human  brain.  Each  connection  is  weighted  to  determine  the  effect  the  output  will 
have  on  the  connecting  processing  element.  All  of  the  inputs  to  a  processing  element  are 


Figure  2:  Basic  Components  of  a  PDF  System  (Ref.  3] 

combined  with  the  current  activation  value  through  an  activation  function  F  which 
determines  the  new  activation  level  for  that  particular  processing  element. 

I).  now  DOES  A  NEURAL  NETWORK  WORK? 

Figure  3  i.s  a  simplified  representation  of  a  neural  network  architecture.  The 
network  consists  of  a  numbe'-  of  processing  elements  all  connected  and  weighted  as 
described  above.  The  elements  of  the  network  are  usually  grouped  into  layers  and  are 
randomly  or  fully  connected  as  shown.  The  first  layer  is  referred  to  as  the  input  buffer 
and  is  the  point  at  which  data  is  presented  to  the  network.  The  output  buffer  holds  the 
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Figure  3:  Example  of  a  Neural  Network  Architecture  [Ref.  3J 

data  produced  as  a  result  of  processing  a  given  input.  Additional  layers  between  the  input 
and  output  layers  are  referred  to  as  hidden  layers. 

As  mentioned  earlier,  learning  in  the  human  brain  takes  place  w'hen  the  strength  of 
the  output  signal  transferred  from  one  processing  element  across  the  synapse  to  another 
processing  element  is  increased.  This  is  similar  to  the  learning  process  occurring  in  a 
neural  network.  As  input  data  is  presented  to  the  network  through  the  input  buffer  it  is 
propagated  to  the  output  buffer,  and  the  output  obtained  is  compared  to  the  desired 
output.  The  error  between  the  desired  output  and  the  actual  output  is  calculated  and  the 
connection  weights  are  altered  based  upon  this  error  until  the  desired  output  is  obtained. 
In  this  way  learning  takes  place  in  the  neural  network  in  much  the  same  way  it  does  in 
the  human  brain. 

Learning  can  be  classified  as  supervised  or  unsupervised.  In  supervised  learning 
the  desired  response  to  a  given  input  is  presented  to  the  output  buffer.  If  the  desired 


output  is  tbp;  same  as  the  input,  the  network  is  called  auto-associative.  If  it  is  different 
from  the  input  it  is  called  hetero-associative.  If  the  desired  output  is  not  shown  tr  the 
output  buffer  unsupervised  learning  takes  place. 

E.  THE  BACK-PROPAGATION  ALGORITHM 

A  typical  network  based  upon  the  back-propagation  algorithm  has  a  structure  similar 
to  that  shown  in  Figure  3.  It  consists  of  an  input  layer,  an  output  layer  and  at  least  one 
hidden  layer.  A  typical  processing  element  in  a  back-propagation  network  is  shown  in 
Figure  4.  The  notation  in  brackets  symboli^es  what  network  layer  is  being  considered. 
The  notation  Xj'*'  represents  the  existing  output  level  of  the  j"’  element  in  layer  s. 


Figure  4:  A  Typical  Back-Propagation  Processing  Element  |Ref.31 
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represents  the  weighted  sum  of  all  inputs  to  the  element  in  layer  s  and  is  the  value 
of  the  connection  weight  between  the  i^*"  element  in  layer  (s- 1 )  to  the  j'*'  element  in  layer 
s. 

The  back-propagation  processing  element  transfers  its  inputs  to  other  processing 
elements  using  the  following  relationship: 

.|i)  _  Y’'  t., 

(2.1) 

X,'-'  =/!//''> 

The  symbol  f  represents  the  transfer  function,  usually  the  sigmoid  function,  but  can  be 
any  differentiable  function.  The  sigmoid  function  is  represented  in  z  transform  notation 
by: 

/(z)  =  (1.0+g-)-'  (2-2) 

1.  Global  Error  Minimization 

A  network  using  the  back-propagation  algorithm  can  be  assumed  to  have  a 
global  error  function  which  is  a  differentiable  function  of  all  connection  weights  in  the 
network.  The  error  that  is  passed  back  through  the  layers  is: 


c  =  -df/a/ 


1^1 


(2.3) 


which  is  a  measure  of  the  local  error  for  each  element  in  layer  s.  In  order  for  learning 
to  take  place,  the  global  error  E  must  b'*  minimized  by  modifying  the  weights  in  the  back- 
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propagation  network.  If  a  vector  i  which  produces  an  output  o  is  input  to  the  network, 
and  a  desired  output  d  is  specified,  then  the  global  error  in  achieving  the  desired  output 
is 

E  =  (2.4) 

where  k  is  used  to  index  the  components  of  d  and  o  and  the  raw  local  error  is  (1^-0^.  The 
scaled  local  error  is  given  by 

=  -deldo  i*do  Jdl  (2.5) 

=  {d,-o,)*ru,) 


To  modify  the  network  weights  the  following  gradient  descent  rule  is  used: 

Avy,,  ^‘^=-lcoef*(dEldWj,  ''’*)  (2-6) 

This  equation  states  that  each  weight  is  changed  by  multiplying  the  magnitude  and 
direction  of  the  negative  gradient  on  the  error  surface  by  the  learning  coefficient  Icoef 
From  the  chain  rule  and  equation  (2.1)  the  change  in  the  connection  weights  can  be 
determined  by 

=  Icoef*  (^-2) 
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The  above  relarionship  only  applies  to  the  output  layer.  The  error  signal  for  hidden  units 
which  do  not  have  a  target  output  is  computed  recursively  in  terms  of  the  error  signals 
of  the  units  to  which  it  directly  connects  and  the  weights  of  those  connections.  [Ref. 
4:pp.  327]  This  relationship  is  given  mathematically  as: 

el-'  =  (2-8) 


An  in-depth  discussion  of  the  back-propagation  algorithm  is  given  in  [Ref.  3:pp.  NCI  1 1- 
NC131]. 

2.  Back-Propagation  Algorithm  Summary 

If  i  denotes  the  input  vector  and  the  desired  output  is  d,  a  general  summary  of 
the  steps  in  the  standard  back-propagation  algorithm  is  given  as  follows: 

•  Propagate  i  from  the  input  layer  through  the  network  to  the  output  layer  to  obtain 
an  output  o.  The  summed  inputs  and  output  states  Xj  for  each  processing  element 
are  set  as  the  information  is  propagated  through  the  network. 

•  Calculate  the  scaled  local  error  using  (2.5)  and  the  delta  weight  using  (2.7)  for  each 
processing  element  in  the  output  layer. 

•  Calculate  the  scaled  local  error  and  the  delta  weight  using  (2.7)  for  each  layer  s 
starting  at  the  layer  preceding  the  output  layer  and  ending  with  the  layer  above  the 
input  layer. 

•  Modify  all  network  weights  by  adding  the  delta  weights  to  the  previous  weights. 
[Ref.  3:pp.  NC-116] 
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3.  Fast  Back-Propagation 


This  thesis  uses  the  fast  back-propagation  control  strategy  available  in 
NEURALWORKS  PROFESSIONAL  II.  The  fast  back-propagation  algorithm  is  a 
variation  to  the  back-propagation  algorithm  that  was  presented  by  Tariq  Samad  at  the 
1988  INNS  Conference.  The  fast  back-propagation  algorithm  replaces  equation  (2.7) 
with: 


(2.9) 


'‘+e 


u-i) .  ^  U-Ds 


which  states  that  the  error  at  layer  [s-1]  and  the  activation  value  are  added  before 
updating  the  weight.  Equation  (2.9)  can  be  expanded  to  show  the  second  order 
relationship  such  that; 


Avv^^  =  lcoef*ej"^  +lcoef*el^^ 


(2.10) 


Another  form  of  equation  (2.10)  proposed  by  Samad  adds  a  multiple,  k,  of  the  error  to 
the  activation  value: 

AH','"  =  <2'") 

Using  fast  back-propagation  can  drastically  reduce  the  number  of  iterations  required  to 
reach  convergence.  [Ref.  3;pp.  NC120-NCI21] 
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III.  ADAPTIVE  CONTROL  THEORY 


The  dynamic  characteristics  of  most  control  systems  are  seldom  constant.  Typical 
feedback  control  systems  are  capable  of  attenuating  the  effects  of  small  changes  in  those 
dynamic  characteristics.  However,  in  order  to  deal  with  large  changes  in  the  system 
parameters  and  environment,  the  control  system  must  have  the  ability  of  adaptation  [Ref. 
l:pp.  5].  The  design  of  an  adaptive  control  system  is  conceptually  simple.  It  includes 
combining  a  particular  parameter  estimation  technique  with  any  control  law.  This 
approach  of  using  the  estimates  as  if  they  were  the  true  parameters  for  the  purpose  of 
design  is  called  certainty  equivalence  adaptive  control  [Ref.  4:pp.  180],  Figure  5  contains 
a  block  diagram  of  a  general  adaptive  control  system.  A  great  many  different  algorithims 
can  be  created  depending  upon  the  parameter  estimation  technique  and  control  law  being 
used.  In  this  thesis  only  the  control  and  estimation  of  deterministic  systems  will  be 
examined.  A  deterministic  system  is  one  in  which  the  system  response  is  completely 
described  by  the  model  and  which  modelling  errors  are  not  significantly  affected  by  noise. 
The  one  step  ahead  control  algorithm  will  be  used  to  develop  the  control  model  while  the 
back-propagation  algorithm  will  be  used  as  a  basis  for  developing  the  estimation  portion 
of  the  adaptive  controller.  A  more  detailed  explanation  of  adaptive  control  and  the  one 
step  ahead  algorithm  is  given  in  (Ref.  4]. 
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Control  law 


- 7^ - 

Objectlvfi 

Figure  5;  Basic  Structure  of  an  Adaptive  Controller  [Ref.  5] 

A.  ONE  STEP  AHEAD  PREDICTION  CONTROL 

One  step  ahead  prediction  control  brings  the  output  y(t+d),  where  d  represents  a 
time  delay,  to  a  desired  output  value  y‘(t+d)  in  one  step.  For  most  control  systems,  it  is 
assumed  that  the  system  is  lincai  and  unite  dimensional.  As  described  in  (Ref.  4:pp  37- 
33],  the  simplest  model  used  to  develop  adaptive  control  algorithms  for  this  type  of 
system  is  the  deterministic  autoregressive  moving-average  (DARMA)  model.  The 
DARMA  mcxlel  can  be  described  by  the  fonnula 


(3.1) 


Aiq)y(t)  =  B(q)u(t) 
where: 

A{q  -')  =  UA^{q)^...^Ai,q) 

Biq  -’)  =  B^^...+BJ,q) 

and  A(q)  and  B(q)  represent  matrix  polynomials  written  in  backward  shift  operator 
notation,  q  ‘.  The  system  output  and  input  are  represented  by  the  discretized  form  of  y(t) 
and  u(t)  respectively.  The  DARMA  model  is  equivelent  to  an  observable  state-space 
model  and  can  describe  the  input-output  properties  of  a  general  state  space  model  having 
an  arbitrary  initial  state  [Ref.  4:pp.  32J.  Expanding  the  single  input  single  output  (SISO) 
DARMA  model  in  the  shift  operator  and  rearranging  equation  (3.1)  gives 

y(r)  =  (3.2) 

which  can  be  used  as  a  predictor  for  the  output  at  the  next  time  step 

y'lr+l)  =  d,u(r)+^jM(r-l)...-a,>’(f)-o^y(^-l)-.  (^-^ 

where  y\t-Hl)  is  the  predicted  value  of  y(t-i-l).  By  replacing  y‘(t-(-l)  with  the  desired 
output  yd(t+l)  and  solving  for  u(t),  the  control  required  to  bring  the  system  to  a  desired 
value  in  one  step  is  given  as: 

w(r)=— LVj(^+ 1  )+a,y(0+a2>’(^- 1  )..-b^u{t- 1 )..]  (3.4) 

b. 

I 

This  equation  represents  the  one  step  ahead  control  law.  [Ref.  2:pp.  17-20]  The  term 
yj(t+l)  in  equation  3.4  can  represent  a  reference  input  to  the  system.  If  the  past  input  and 
output  values,  u(t)  and  y(t)  are  state  variables,  the  one  step  ahead  controller  can  be 
thought  of  as  a  state  variable  feedback  with  a  reference  input  controller  [Ref.  2:pp.  19|. 
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M(r)  =  K(t)x{t)+rit) 


(3.5) 


The  state  variable  in  equation  (3.5)  is  made  up  of  the  vector  containing  the  inputs  and 
outputs  of  equation  (3.4)  and  provides  a  controller  for  an  adaptive  algorithm  [Ref.  4:pp. 
118-171].  Using  the  vector  of  past  input  and  output  measurements  as  some  state  vector, 
the  idea  of  a  controller  based  on  the  weighted  sum  of  state  variables  and  a  reference  input 
may  be  developed  [Ref.  2:pp.  20].  The  input  to  a  neural  network  processing  element  is 
defined  as  the  weighted  sum  of  all  inputs  from  processing  elements  connected  to  it. 
Therefore  a  processing  element  in  a  neural  network  is  capable  of  representing  this  type 
of  controller. 

B.  LINEAR  LEAST  SQUARES  ESTIMATION 

As  previously  mentioned,  adaptive  control  consists  of  two  functions,  estimation  and 
control.  A  derivadon  of  one  form  of  the  linear  least  squares  estimator,  the  recursive  least 
squares  method,  was  performed  to  develop  a  general  structure  for  estimation  in  [Ref.  2]. 
The  general  form  of  the  predictor  corrector  equation  for  all  least  squares  parameter 
estimation  schemes  was  given  as: 

e(r+l)  =  <!)(/) +M(r)<I)(t-l)e(r)  (3.6) 

where: 

M(t)..is  the  algorithm  gain 
d)(t-l)..is  the  regression  vector 
e(t)..is  the  model  prediction  error 

The  back-propagation  learning  rule  discussed  earlier  is  similar  to  the  general  form  of  the 
linear  least  squares  parameter  estimator  in  equation  (3.6).  In  fact,  a  neural  network  with 
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a  linear  activation  function  is  a  parallel  distributed  processing  implementation  of  the 
general  linear  least  squares  estimator  [Ref.  2:pp.  22],  Therefore,  the  theorems  and  proofs 
that  are  applicable  to  least  squares  estimation  are  in  a  general  sense  applicable  to  a 
network  using  the  back-propagation  algorithm. 

By  combining  the  control  and  estimation  algorithms  dp“scribed  in  this  and  the 
previous  section,  an  adaptive  control  structure  was  developed  in  [Ref.  2].  Because  of  its 
similarities  with  this  structure,  the  back-propagation  neural  network  was  used  to  produce 
models  for  neural  network  adaptive  control.  Neural  network  adaptive  control  structures 
were  developed  for  the  longitudinal  motion  of  the  A-4  aircraft.  In  this  thesis,  those 
models  will  be  applied  to  the  lateral/directional  equations  of  motion  of  the  A-4  aircraft. 
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IV.  EXPERIMENTAL  SETUP 


A.  HARDWARE  AND  SOFTWARE  USED 

All  data  processing  for  this  thesis  was  done  on  the  Sun  386i/250  workstation  using 
the  Neuralworks  Professional  n  software  package  by  Neuralware,  Inc.  The  Sun  386i/250 
workstation  uses  a  full  32-bit  architecture  with  a  25  MHz  Intel  80386  central  processing 
unit  (CPU).  It  has  an  XP  cache  memory  card  with  4  MBytes  of  main  memory  for 
performance  that  exceeds  five  million  instructions  per  second  (MIPS).  The  configuration 
used  for  this  thesis  included  16  MB  of  memory,  a  VGA  adapter,  a  16  inch  high  resolution 
color  monitor,  one  3.5  inch  floppy  disk  drive  and  a  0.25  inch  tape  drive.  The  Sun 
operating  system  provides  a  windowed  environment  which  allows  multiple  tasks  to  be 
performed  at  the  same  time,  greatly  enhancing  the  flexibility  of  the  system. 

The  software  used  for  this  thesis,  Neuralworks  Professional  11,  offers  the  capability 
of  design-ng  over  a  dozen  different  types  of  networks.  Neuralworks  supports  a  general 
file  format  for  reading  data  into  the  network  that  encompasses  standard  spreadsheet  file 
formats.  Input-output  may  also  be  accomplished  through  keyboard  interface,  formatted 
ASCII  files  or  user  defined  modules  (Ref  3:pp.  UG215-UG250].  Different  variables  such 
as  weights,  error  values,  and  activation  levels  can  be  displayed  graphically  through  the 
use  of  probes  which  monitor  and  display  the  activation  values  of  these  parameters. 

As  mentioned  earlier,  Neuralworks  provides  the  user  with  the  capability  of  accessing 
the  network  through  the  use  of  a  user  defined  module.  This  method  of  access  is  achieved 


16 


by  attaching  a  user  written  procedure  to  the  network  [Ref.  3:pp.  UG237].  The  source 
code  for  this  procedure,  the  USERIO  program,  is  provided  as  pan  of  the  Neuralworks 
software  package.  Control  strategies  for  input-output  operations,  learning  and  propagation 
are  provided  for  all  standard  network  types.  They  can  also  be  user  defined.  The  control 
strategies  and  USERIO  programs  used  in  this  thesis  are  the  same  as  those  used  in  [Ref. 
2]  with  the  exception  of  the  numerical  values  for  flight  conditions  and  numerator  and 
denominator  coefficients  in  the  header  file  Transfer.txt.  Complete  listings  of  these 
programs  can  be  found  in  [Ref.  2].  A  listing  of  the  transfer.txt  file  with  values  used  in 
this  thesis  is  found  in  Appendix  A. 

The  transfer  function  numerator  and  denominator  coefficients  used  as  input  for  the 
networks  in  this  simulation  were  obtained  through  the  use  of  MATLAB,  a  high- 
performance  interactive  software  package  for  scientific  and  engineering  computation  [Ref. 
5:pp.  3].  In  addition,  MATLAB  was  used  to  perform  frequency  response  analysis  for  the 
various  flight  conditions  for  comparison  with  the  responses  generated  by  the  neural 
network. 


B.  LATERAL/DIRECTIONAL  MOTION  OF  THE  A-4  AIRCRAFT 


The  stick  fixed  lateral/directional  motion  of  an  airplane  disturbed  from  equilibrium 
is  described  in  detail  in  [Ref.  6:pp.  152-175]  and  [Ref.  7:pp.  353-414].  As  noted  in  those 


descriptions,  the  lateral/directiona!  equations  of  motion  can  be  arranped  in  the  state 


variable  form; 
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x(t)  =  Ax(t)+Bu(t) 
y(t)  =  Cx(t)+Du(t) 
where: 

P(r)..>'avv  Z  perturbation 
x{t)  =  pit).. roll  rate  perturbation 
rit)..yaw  rate  perturbation 
<t>it)..roll  Z  perturbation 


and  the  input  variable  is: 


uit)  =  d ^...aileron  deflection 
d  ^...rudder  deflection 


(4.2) 


The  output  variables  are  scaled  versions  of  the  state  variables.  The  A  and  B  matrices  are 
functions  of  the  airplane  dimensional  stability  derivatives,  mass  and  inertia  characteristics 
for  a  given  altitude  and  mach  number.  The  C  matrix  is  a  scaling  matrix  and  the  D  matrix 
is  a  matrix  of  zeros.  The  lateral  frequency  response  of  the  A-4  airplane  (ie.,  response  due 
to  an  aileron  input  only)  at  mach  .638  and  20,000  feet  is  presented  in  Figure  6.  The  low 
frequency  dutch  roll  mode  can  be  seen  at  a  natural  frequency  of  about  .3  Henz  with  a 
time  period  of  approximately  3  seconds.  The  directional  frequency  response  of  the  A-4 
airplane  (ie.,  response  due  to  a  rudder  input  only)  at  mach  .638  and  20,000  feet  is 
presented  in  Figure  7.  As  was  done  in  [Ref.  2),  several  different  linear  models  were  used 
for  different  flight  conditions  in  the  experiment  to  introduce  non-linearity.  The  linear 
models  used  are  shown  in  Table  1. 

Simulation  of  the  lateral  and  directional  motion  of  the  A-4  airplane  was  conducted 
by  using  the  USERIO  subprogram  simo  and  the  header  file  transfer.txt.  Continuous  state 
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magnitude  (dB) 


Figure  6:  A-4  Lateral  Frequency  Response  at  Mach  .638,  2(),()()()  Feet 
Table  I:  Flight  Conditions  Used  in  This  Experiment. 


Flight  Condilion 

1 

2 

3 

4 

5 


Mach  #  Altitude 

.4  sea  level 

.638  20, 000  ft. 

.5  35.000  ft. 

.7  35.000  ft. 

.85  sea  level 
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Figure  7:  A-4  longitudinal  Frequency  Response  at  Mach  .638,  20.()(X)  Feet 


space  models  of  each  of  the  five  flight  conditions  were  produced  and  converted  to 
difference  equations  (3.3)  using  the  MATLAB  script  file  shown  in  Appendix  B.  The 
continuous  state  space  matrices  and  discrete  transfer  function  matrices  for  each  condition 
are  shown  in  Appendix  C  and  Appendix  D.  Data  for  the  transfer.txt  header  file  was 
obtained  by  making  computations  described  in  the  MATLAB  reference  manual  [Ref.  6:pp. 
C4-C26|.  The  matrices  were  converted  from  continuous  to  discrete  state  space  fomi  using 
a  matrix  polynomial  algorithm  [Ref.  2j.  Next  the  discrete  matrix  was  converted  to  a 
transfer  function  matrix  using: 
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H{z)=C(2l -Ay^B=Yiz)/uiz) 


(4.3) 


By  replacing  the  z  transform  with  the  backward  shift  operator  q  ‘,  the  numerator  and 
denominator  terms  were  used  to  create  the  DARMA  model; 

A(q)yit)=B{q)u(t) 

Rearranging  equation  4.4  gives: 

y(t)^B(q)u(t)-iA(q)-l)\il)  (4.5) 

By  expanding  the  matrix  polynomials  the  following  equations  are  obtained: 

By  expanding  the  delay  operator  temis  four  recursive  equations  are  obtained  of  the  form: 

where  the  output  y^  is  made  up  of  the  outputs  P(t),  p(t),  r(t),  and  0(0  and  the  a,  terms  are 
the  same  for  each  equation.  The  parameters  in  equation  (4.5)  and  (4.6)  are  used  in  the 
USERIO  program  to  simulate  the  lateral  motion  of  the  A-4  aircraft.  A  sample  of  the  B(q) 
and  A((q)  -  1)  coefficients  used  for  the  condition  of  20,000  feet  and  Mach  .638  with 
aileron  input  only,  is  given  in  Table  11. 
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Table  II:  Paramters  for  Flight  Condition  20,000  Feet/Mach  .638  With  a  Sampling 
Time  of  0. 1  Seconds 


B(q)  = -1.2688e-04  2.6534e-04  4.3990e-05  -1.8149e-04 
1.5764e-01  -4.6480e-01  4.6208e-01  -1.5491e-01 
7.098 le-05  -2.3526e-04  2.5885e-04  -9.3603e-05 
1.4496e-05  -1.4546e-05  -1.2449e-05  1.3462e-05 


A(q)-1  =  -3.7928e+00  5.4207e+00  -3.4572e+00  8.2934e-01 


Note  that  the  B(q)  and  A((q)  -  1)  terms  match  the  numerator  and  denominator  terms  in 
the  transfer  function  matrix  for  this  flight  condition  shown  in  Appendix  C.  The  discrete 
frequency  response  for  this  simulation  is  shown  in  Figure  8  while  the  discrete  frequency 
response  for  this  simulation  due  to  a  rudder  input  is  shown  in  Figure  9. 

C.  MODEL  DEVELOPMENT 

A  detailed  description  of  the  development  of  models  used  for  this  thesis  is  given 
in  [Ref.  2].  The  first  model  used  was  the  linear  neural  network  with  no  hidden  lavers 
paramaterized  as  four  transfer  functions  and  shown  in  Figure  10.  The  first  layer,  the 
feedback  layer,  consists  of  past  values  of  outputs  and  inputs.  From  left  to  right  the  first 
three  elements  are  past  values  of  input  5(t-l),  5(t-2)  and  5(t-3)  where  the  delay  value  is 
noted  in  parentheses.  The  remaining  elements  are  past  output  values  for  P(t),  p(t),  r(t) 
and  <l>(t).  The  second  layer,  the  command  layer,  replicates  the  first  with  the  e:<ception 


of  the  reference  input  r(t-l),  which  simulates  the  stale  variable  plus  reference  input  for 
the  control  law.  The  third  layer,  the  control  layer,  consists  of  one  element  w'hich  is  a 
weighted  sum  of  the  reference  input  and  the  output  command  layer. 

The  output  elements  each  have  eight  connections,  four  of  which  are  connected  to 
the  5(t)  elements  which  represent  the  b,  terms  in  equations  (4.5)  and  (4.6).  Using  this 
network  structure,  the  weights  of  eacli  output  element  can  be  compared  directly  to  the 
coefficients  of  the  true  system  being  simulated. 
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Figure  9:  Discrete  Frequency  Response  for  the  Longitudinal  Motion  of  the  A-4 
Aircraft 


For  the  purpose  of  control  and  estimation,  this  network  can  be  considered  to  have 
no  hidden  layers  since  all  inputs  are  directly  connected  to  the  output  layer.  However, 
when  examining  it  from  a  neural  networks  standpoint,  it  can  be  seen  that  the  single 
element  in  the  third  layer  is  a  hidden  layer  through  which  the  output  of  layer  two  is 
transferred  to  the  fourth  layer. 

The  .second  type  of  network  used  in  this  thesis  is  shown  in  Figure  11.  It  replicates 
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Fi}>iire  10:  Linear  Neural  Network  Adaptive  Controller  Stnicture 
the  linear  neural  network  shown  in  Figure  10  w'ith  the  exception  that  the  output  layer  is 
fully  connected  to  the  feedback  and  control  layers. 

D.  NETWORK  STARILITY 

Systems  whose  transfer  functions  have  poles  or  7eros  outside  the  unit  circle  in  the 
z  plane  are  called  nonminimum  phase  systems.  I'he  poles  and  zeros  of  A(q)  and  B(c])  for 
the  simulation  at  condition  2  (Table  I),  for  an  aileron  and  rudder  input  are  given  in  Table 
111.  In  the  case  of  a  simulation  of  an  aileron  input  it  can  be  seen  that  Pltl  and  r(t)  have 


Hcur«iWorks  Trofcsslonal  II  (tn)  serial  nunber  MU2Cii-20?.05 
Copgrlglit  (c)  19U7-1!IU3  bg  HcuralMarc.  lnc«  fill  Blgltis  Heserved. 

Figure  11;  Fully  Connected  Linear  Neural  Network  Adaptive  Controller  Structure 
zeros  outside  the  unit  circle  and  p(t)  has  a  zero  on  the  unit  circle.  In  the  rudder  input 
case,  P(t),  p(t)  and  0(1)  all  have  zeros  outside  the  unit  circle  and  r(t)  has  a  zero  very  near 
the  unit  circle.  These  zeros  are  nonminimuin  phase.  Although  the  simulation  used  in  the 
USERIO  program  could  generate  data  indefinitely,  modeling  errors  result  from  the 
recursive  nature  of  the  simulation  and  the  presence  of  nonniinimum  phase  zeros.  Errors 
in  the  simulation  propagate  at  a  rate  proportional  to  the  power  of  the  absolute  value  of 
the  system  zeros.  [Ref.  2:pp.  43]  Since  many  of  the  zeros  of  the  system  are  outside  the 
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Table  ID:  Poles  and  Zeros  of  the  Discrete  Simulation  for  Condition  2  with  a 
Sampling  Time  of  0. 1  Seconds 


aileron  input 

rudder  input 

poles  = 

0.9779  +  0.1859i 

0.9779  +  0.1859i 

0.9779  -  0.1859i 

0.9779  -  0.1859i 

1.0001 

1.0001 

0.8370 

0.8370 

zeroSp^,)  = 

1.8664 

1.0004 

0.9951 

0.8393 

-0.7702 

-0.7067 

zeroSp^.j  = 

1.0000 

1.3381 

0.9743  +  0.1830i 

1.0000 

0.9743  -  0.1830i 

0.7738 

zeros^,)  = 

1.2334  +  0.1858i 

0.9994  +  0.0293i 

1.2334  -  0.1858i 

0.9994  -  0.0293i 

0.8476 

0.8372 

zeros4,(,)  = 

0.9743  +  0.1830i 

1.3347 

0.9743  -  0.i830i 

0.7740 

-0.9450 

-0.9300 

unit  circle,  errors  in  the  simulation  could  grow  unbounded.  To  keep  these  errors  from 
becoming  signifigant,  the  USERIO  program  resets  the  simulation  every  9000  cycles. 
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V.  RESULTS  AND  DISCUSSION 


This  chapter  will  examine  the  results  of  the  simulations  conducted  using  the 
networks  described  in  the  previous  Chapter.  The  ability  of  the  linear  neural  network 
adaptive  control  structure  in  estimation  will  be  examined.  Performance  of  the  network 
will  be  determined  through  the  simulation  of  lateral  and  directional  motion  of  the  A-4 
airplane.  Finally,  a  fully  connected  networks’  operation  will  be  examined. 

A.  ESTIMATION  DEMONSTRATION 

Estimation  trials  were  conducted  by  using  the  neural  network  adaptive  control 
structure  described  in  chapter  4  and  skipping  the  control  law  synthesis  phase  of  op  .ration 
for  each  sample.  To  do  this,  the  weights  between  all  elements  in  the  command  layer, 
except  the  reference  input,  were  set  to  zero. 

I.  Linear  Network  Estimation  of  Lateral  Motion 

The  ability  of  the  linear  neural  network  in  estimation  was  first  examined  by 
simulating  the  lateral  motion  of  the  A-4  aircraft  at  Mach  .638/20,000  feet.  The  network 
used  is  shown  in  Figure  10  and  was  trained  for  50,000  (5,000  seconds),  100,000  (10,000 
seconds),  and  200,000  cycles  (20,000  seconds)  using  a  pseudo  random  binary  input  shown 
in  Figure  12.  This  input  consists  of  a  random  binary  input  that  has  been  bandlimited  by 
allowing  it  to  change  every  two  samples  versus  every  sample.  The  drop  in  energy  above 
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ten  Hertz  limits  the  excitation  of  high  frequency  noise  which  was  shown  to  be  a  problem 
in  previous  research. 


Because  this  is  a  linear  network,  the  weights  of  the  network  can  be  equated 
to  the  numerator  and  denominator  terms  in  the  transfer  function  model  of  the  lateral  and 
directional  equations  of  motion.  A  compari.son  of  the  weights  for  p(t)  and  P(t),  which  are 
representative  of  the  lateral  and  directional  motion  of  the  A-4  aircraft,  are  compared  with 
the  true  system  variables  in  Table  IV. 

The  values  of  b,  and  a,  detennined  by  the  network  for  p(t)  are  similar  in 
magnitude  to  the  true  values  although  in  some  cases  the  signs  are  incoirect.  This  is  not 
true  for  P(t).  Tliis  uould  seem  to  indicate  that  the  network  has  built  a  better 


representation  of  tlu)sc  terms  affected  by  an  aileron  input,  (ie.,  lateral  motion),  which  is 


Table  IV:  Network  Weights  at  200,000  Cycles 


Terms 

500k  Model 

True  Model 

1.556e-01 

1.576e-01 

bp2 

1.212e-01 

-4.648e-01 

bp3 

5.210e-02 

4.621e-01 

V 

3.440e-02 

-1.549e-01 

-9.680e-01 

-3.793e-(-00 

^2 

-2.729e-01 

5.421e-KX) 

ap3 

-1.115e-01 

-3.457e-HX) 

ap4 

-1.416e-01 

8.293e-01 

bpi 

5.023e-02 

-1.269e-04 

6.290e  02 

2.653e-04 

bp3 

-9  -03 

4.399e-05 

1  \X)e-03 

-1.815e-04 

6.520e-03 

-3.793e-i-00 

^2 

-1.025e-03 

5.421e-(-00 

^3 

-6.390e-02 

-3.457e-t-00 

5.830e-02 

8.293e-01 

being  simulated  in  this  case. 

The  weights  of  the  network  can  be  used  to  generate  discrete-time  Bode 
frequency  response  plots  for  comparison  with  the  frequency  response  of  the  true  system. 
The  frequency  response  plots  for  the  lateral  modes  of  the  A-4  aircraft  estimation  using 
the  linear  network  are  shown  in  Figure  13  through  Figure  16.  The  response  for  P(t)  is 
shown  in  Figure  13.  The  network  failed  to  develop  a  good  frequency  model  or  the  proper 
mode  shape  for  this  parameter.  However,  Figure  14  shows  that  a  much  better  model  of 
the  p(t)  parameter  was  achieved.  This  is  to  be  expected  since  the  level  of  excitation  of 
the  p(t)  and  d)(t)  variables  is  much  larger  since  the  only  input  being  simulated  was  that 
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Figure  14:  System  and  Network  Frequency  Response  for  p(t) 
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Figure  16:  System  and  Network  Frequency  Response  for  <t>(t) 
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from  the  aileron.  The  lack  of  excitation  of  the  directional  variables  P(t)  and  r(t)  is  also 
shown  in  Figure  15  where  the  network  did  a  poor  job  of  modelling  the  frequency- 
response  of  r(t).  In  Figure  16,  the  frequency  response  of  <I>(t)  is  modeled,  however  the 
proper  mode  shape  is  not  obtained  even  through  increased  training. 

2.  Linear  Network  Estimation  of  one  Parameter 

Because  there  were  large  differences  in  the  orders  of  magnitude  between  the 
b  coefficients,  and  NeuralWorks  Professional  II  only  provides  precision  to  (10)  ^  it  was 
difficult  for  the  network  to  model  the  entire  system.  Therefore  a  second  experiment  using 
the  linear  network  involved  a  modification  in  which  the  p(t),  r(t)  and  <I>(t)  processing 
elements  in  the  network  were  disabled.  It  was  thought  that  the  increased  excitation  of  a 
single  parameter  due  to  the  lack  of  problems  caused  by  large  differences  in  orders  of 
magnitude  between  parameters  would  give  a  better  model  of  the  p(t)  parameter.  Figure 
17  shows  that  a  near  exact  model  of  the  frequency  response  and  mode  shape  of  p(t)  was 
obtained  by  50,000  cycles  (5,(X)0  seconds). 

3.  Network  Estimation  of  Directional  Motion 

The  ability  of  the  linear  neural  network  in  estimation  of  the  directional  motion 
of  the  A-4  aircraft  was  tested  using  the  same  network  discussed  in  the  previous  section. 
However,  the  input  presented  to  the  model  by  the  USERIO  program  now  simulated  the 
directional  motion  of  the  A-4  aircraft.  The  system  and  network  model  frequency 
responses  due  to  a  rudder  input  are  shown  in  Figure  18  through  Figure  21.  The  error  for 
each  output  resulting  from  testing  this  network  with  a  pseudo  random  binary  input  was 


less  than  five  percent  for  the  P(t)  and  p(t)  variables,  zero  percent  for  r(t)  and 
approximately  forty  percent  for  <b(t).  This  would  indicate  that  the  response  for  all 
variables  except  <l>(t)  have  been  learned  by  the  network  and  should  be  modelled  correctly. 
However,  as  shown  in  Figure  18  through  Figure  20  this  is  not  the  case.  Once  again  the 
networks  failure  to  model  the  entire  system  response  is  due  to  the  failure  of  the 
Neuralworks  Professional  11  software  to  handle  large  differences  in  the  orders  of 
magnitude  between  the  b  coefficients  in  Fejuation  (4,6).  Figure  18  shows  that  higher 
frequency  noise  dynamics  adversely  effected  modeling  of  the  response  above  one  Hertz 
but,  by  50,000  cycles  (5,000  .seconds),  a  good  approximation  of  the  frequency  response 
and  mode  shape  was  achieved  for  the  P(t)  parameter.  However,  the  model  does  not 
change  much  with  further  training  and  the  higher  frequency  mode  shape  is  not  modelled 
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Figure  18:  System  and  Network  Frequency  Response  for  P(t) 


even  after  500,000  cycles  (50,000  seconds).  In  Figure  19  it  can  be  seen  that  the  modeling 
of  the  higher  frequency  mode  shape  for  the  dutch  roll  response  of  r(t)  improved  with 
increased  training.  Although  the  entire  mode  shape,  with  the  exception  of  the  low 
frequency  zero  response,  was  modelled  well,  the  magnitude  of  the  networks  response  did 
not  give  an  accurate  representation  of  the  true  system  response.  The  low  frequency  zero 
response  was  not  modeled  because  the  system  is  modelling  the  high  frequency  dyanamics 
of  the  system  and  does  not  have  enough  degrees  of  freedom  to  model  the  entire  system. 
As  expected.  Figure  20  and  Figure  21  show  that  the  p(t)  and  <l)(t)  parameters  are  not 
modeled  very  well  during  estimation  of  the  directional  motion  of  the  A-4  aircraft.  In 
figure  20  the  low  frequency  mode  shape  is  modelled,  however  the  magnitude  is  less  than 
that  of  the  true  system.  The  dutch  roll  response  is  not  modelled  and  the  presense  of 
unmodelled  noise  dynamics  in  the  frequencies  above  one  Henz  is  signifigant.  In  figure 
21  it  can  be  seen  that  neither  the  frequency  response  or  the  mode  shape  are  modelled  over 
the  entire  frequency  range.  An  examination  of  the  networks  output  for  the  <l>(t)  parameter 
shows  that  the  output  is  not  indicative  of  the  systems  response  to  a  random  binary  input. 
Rather  it  seems  to  be  a  numerical  oscillation  about  some  mean  value  which  is  unaffected 
by  the  input  to  the  system. 

4.  Fully  Connected  Linear  Neural  Network 

The  second  linear  network  to  be  examined  was  the  network  shown  in  Figure 
1 1  and  discussed  in  the  previous  chapter.  The  network  was  fully  connected  which  means 
that  all  the  elements  in  the  feedback  layer  were  connected  to  all  the  elements  in  the 
output  layer.  The  network  was  trained  on  inputs  simulating  the  lateral  motion  of  the  A-4 
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aircraft  at  Mach  .638  and  20,000  feet.  The  network  seems  to  have  developed  a  very  good 
model  of  the  input-output  relationship  of  the  true  system.  The  dynamic  estimation  error 
of  all  paramaters  with  the  exception  of  d)(t)  went  to  zero  in  under  5,000  cycles  (500 
seconds).  This  is  due  to  the  highly  overparamaterized  nature  of  this  network  which 
allows  a  better  ballanced  representation  of  the  system.  Also,  because  it  is  fully  connected, 
crosstalk  between  elements  allows  each  output  to  develop  dependencies  on  past  values 
of  other  outputs. 
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VI.  CONCLUSIONS 


In  this  thesis  a  description  of  neural  network  processing  and  adaptive  control  theory 
has  been  presented.  The  relationship  between  neural  networks  and  adaptive  control  theory 
was  discussed  as  was  the  use  of  these  two  tools  to  develop  a  neural  network  model  for 
adaptive  control.  That  model  was  used  to  show  that  neural  networks  can  be  successfully 
used  in  the  estimation  of  linear  approximations  of  the  lateral  and  directional  motion  of 
the  A-4  aircraft. 

The  use  of  the  neural  network  adaptive  control  structure  was  first  demonstrated  on 
the  system  of  lateral  motion  of  the  A-4  aircraft.  Estimation  capabilities  were  shown  using 
a  linear  neural  network  paramaterized  as  four  separate  transfer  functions.  The  weights 
of  the  network  were  compared  to  the  bj  and  a;  terms  of  Equation  (4.6)  to  show  that  the 
network  built  a  better  representation  of  those  terms  affected  more  by  an  aileron  input  (ie., 
p(t)  and  <l)(t)).  The  weights  of  the  network  were  then  used  to  generate  discrete-time  Bode 
frequency  response  plots  for  comparison  with  the  frequency  response  of  the  true  system. 
The  network  performed  well  at  modelling  the  p(t)  and  d>(t)  variables  and  not  the  P(t)  and 
r(t)  variables.  This  was  due  to  the  fact  that  the  level  of  excitation  of  the  p(t)  and  d)(t) 
variables  was  much  larger  because  the  only  input  being  simulated  was  that  from  an 
aileron.  A  second  experiment  was  conducted  with  this  network  to  illustrate  the  problems 
the  network  has  with  modelling  the  entire  system  response  because  of  large  differences 
in  the  orders  of  magnitude  between  the  b  coefficients  of  Equation  (4.6).  The  P(t),  r(t), 
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and  d>(t)  parameters  were  disabled  and  the  network  was  run  as  before.  The  increased 
excitation  enabled  an  almost  exact  model  of  p(t)  to  be  obtained  by  50,000  cycles  (5,000 
seconds). 

A  second  demonstration  of  this  structure  on  the  system  of  directional  motion  of  the 
A-4  aircraft  reinforced  the  impKrrtance  of  excitation  levels  on  parameter  estimation.  Those 
variables  describing  the  directional  motion  due  to  a  rudder  input  (ie.,  P(t)),  and  r(t),  were 
modelled  reasonably  well  where  as  the  p(t)  and  <I>(t)  parameters  were  not.  The  networks 
failure  to  model  both  the  high  and  low  frequency  dynamics  of  the  r(t)  variable  showed 
that  the  network  did  not  have  enough  degrees  of  freedom  to  model  the  entire  system. 

A  final  fully  connected  version  of  the  linear  network  proved  to  be  much  faster  and 
more  efficient  in  arriving  at  a  representation  of  the  true  system.  This  was  due  to  the 
highly  oveiparamaterized  nature  of  the  network  which  allowed  for  a  better  ballanced 
representation  of  the  system.  In  addition,  crosstalk  between  elements  allowed  outputs  to 
develop  dependencies  on  past  values  of  other  outputs. 

The  potential  for  the  use  of  neural  networks  in  adaptive  control  shows  much 
promise.  Funher  study  is  needed  to  develop  further  nonlinear  and  linear  control  and 
estimation  neural  network  structures.  Ways  of  increasing  the  stability  of  the  networks 
other  than  random  adjustments  of  the  learning  rate  should  be  pursued.  With  the  continued 
advancements  being  made  in  modem  aircraft  systems,  the  need  for  better  automatic 
control  systems  is  apparrent.  Neural  networks  offer  one  way  of  making  those 
improvements. 
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APPENDIX  A:  NEURALWORKS  PROFESSIONAL  II  ASSOCIATED  PROCJRAMS 


/*  This  file  contains  transfer  function  data  for  aileron  inputs  otily  */ 


*  Source: 

*  Executable: 

*  Version: 

*  Date: 

*  Author : 

*  Project  : 

*  Env  i  ronmejit : 

*  Path: 

*  Oescr ipt i on : 


*  Pev i s i ons : 

* 

************** 


trans  f  er . tx t  * 

SITPO  * 

1.5  * 

2?  November  19B9  * 

R.  W.  Scott  * 

Neural  Networks  in  Adaptive  Control  * 

UNIX/SunOS  C  * 

e i 1 een : /home / r  scot t / n works/ text  files  * 

This  is  the  header  file  used  to  define  the  variablr?;  ♦ 

used  in  the  USEPIO  subprogram  simo.  This  allows  ea-y  * 

reconfiguration  of  the  executables  by  simply  changing  * 

information  in  the  header  file.  Inputs  include  nit  ituiect,  * 

airspeeds,  the  sampling  time^  selected  I  r  equen'-*  i  r-c  mul  * 

and  weightings  for  a  sum  of  sine  waves  input,  labels  fr'j  tl^e  * 
inputs,  conditions,  and  states,  and  the  coefficients  for  the  * 
numerators  and  denominators  of  the  system  and  varjc.is 
used  to  generate  filtered  noise.  * 

--Inclusion  of  multiple  input  typos  * 

--Running  the  sim  at  twice  the  speed  of  the  network  * 

**.******.*****.*.******.****.****.. A*..*..*.*. 


/*  Altituclp!?  in  thousai\ds  of  feet  ‘/ 

static  double  altitude(5)- 

0. 0, 0. 20, O.iSO, 0.350, 0.0 

)  ; 


/*  Marh  Numbers  */ 

static  double  m.ach(5)- 

{ 

O.'t, 0.0  38, 0.5, 0.7, 0.05 

)  ; 

/*  Sampling  Time  */ 

static  double  ts-(O.l); 

/*  Frequencies  for  sum  of  sine  waves  input  */ 

static  double  freq(R]'( 

0.005,0.09,0.11,0.05.1.5,2.75,3.0,10.0 

)  ; 

/*  Frequency  weighting  for  sum  of  sine  waves  input  */ 

static  double  weiqtit[PJ^( 

2. 0,3. 0,2. 0,3. 0,2. 0,3. 0,2. 0,0. 5 

)  ; 
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/*  Input,  condition,  statn,  and  filter  labels  ♦/ 


static  char  *  i  npv.jt  _nanie  |  "  1 1  leqa  1  Input*' ,  *’Pandom  Binary", 

''Filtered  RB"  ,  "Composite  S  i  rie’* ,  "Swept  Square  Wave-1est  Only'', 
"Composite  Sim"  ,  "Composite  Tiine’*); 

static  char  *cond  i  t  i  onnarro  [  )  =  ( "  1 1 1  eqa  1  Conditioi^", 

"M  0.4/SL",  "M  0.638/20K",  "M  0.5/35K",  "M  0.7/35",  "fl  0.85/Sl"} 

static  char  *stat e_na me []-{"! I legal  Sta te" , "Beta ( t ) " , "p ( t ) " , 

"r(t)",  "rhict)"}; 

static  char  *f i 1 tpr  name ( )  =  { "1 1 loqa 1  F i 1  ter ” , "0 . 5  Hz  co" , 

”0.2  Hz  co","p  App  M  0. 63P/20K" ) ; 


/*  Numerator  coefficients  */ 

/*  Order  is  bl-b-l ,  pi -p<t ,  r  l-r4  ,  phi  l-phi4  for  the  inner  indices  and 
Condition  1-Condition  5  for  the  outer  index  */ 
static  double  num [ 5 ) ( 4 ) ( 4  ) - 

(  -9. 392687191756011e-05, 

1.126920702549938e-04, 

8.838979111214229e-05, 

-8. 642769199 473601e-05, 

1.561722 08 4664705e-01, 

-4.329135858468582e-01, 

4.196908292547947e-01, 

-1.429494518744069e-01, 

1.511260356292787e-04, 

-2. 9 7 790405303644 Oe -04, 

1.770908276808036e-04, 

-9. 699117334283 08 le- 06, 

7.434958128005320e-05, 

-6. 1 480220509224 64e-05, 

-5.645812760857183e-05, 

6.431610744550564e-05, 

-1.2688133571003856-04, 

2.6533994721500426-04, 

4.3989916350906106-05, 

-1 .8148567878117926-04, 

1.5763648384371996-01, 

-4.6480104339569370-01, 

4.6207673900429486-01, 

-1.5491217953232046-01, 

7.0981483787661006-05, 

-2.3526296186027206-04, 

2 . 5884754 1547702 16-04 , 

-9.3603018969434796-05, 

1.4495986451201706-05, 

-1.4546460411324356-05 
-1 .2448603428971696-05, 

1.3462122399166006-05, 

6.7298440313958716-03, 

3.1976811928469156-03, 

-7.8546725318133786-03, 

6.3014122092857066-03, 

1.0624709218964286-01, 

-3.1592318570526166-01, 

3.1870580027252206-01, 

-1.0902970675690256-01, 


'1.4399124172023826-02, 
4. 165280352077 08 3e-02, 
-4. 00705686679674 3e-02, 
1.285004639771638e-02, 
3. 2 38832047 39861 Oe -04, 
-3. 21836733247593 5e-04 
-2.938511651602305e-04, 
3.2556179418352656-04, 
3.5105455109851756-04, 
-3.0165942727222736-04, 
-3.5144855153124156-04, 
3.0634140521845776-04, 
8.4703256855595216-01, 
-2 . 4097021378371066-02, 
2 . 3 726964 176166026-01 , 
-8.1002684833545456-02, 
-1.7915871317741866-04, 
5.4940874563413906-04, 
-5.5472485293428526-04, 
1.8876280137403176-04, 
1.9514979143320236-05, 
-1.7021790998938976-05, 
-1.6356707221554246-05, 
1.8151500251639706-05, 
-7. 78461464465296 5e -03, 
5.7478007618421156-03, 
7.0314962950126516-03, 
-4.9106487315669916-03, 
2.8511171097457406-01, 
-6.1406467457499626-01, 
5.5928055875093556-01, 
-2.3032759515051376-01, 
3.0218861086135366-03, 
-7 .7493795139043096-03 , 
6. 626904 5640181556-03, 
-1.8153758792542886-03, 
6.7634460290122436-05, 
-1.7856738151245116-05, 
-1.4109496382808126-05, 
4.8367042487451616-05, 
)  ; 


/*  I)6nom  i  n-Ttor  co6£ficients  */ 

/*  Orrl6r  is  rl6nl-d6n4  for  th6  intier  index  and  Condition  1-Condition  5 
for  the  outer  index  */ 
static  double  den(5](4)- 


-3.617552264583115etOO, 
5.03011 11976312646*00, 
-3.1851335576713526*00, 
7.7259523210692856-01, 
-3.7928221305612516*00, 
5.4206963168539066*00, 
-3.4572191706753136+00, 
8.2934420910879546-01, 
-3.8449789564709556*00, 
5.6040438905201886+00, 
-3.669675666585049e+00, 
9.1061052302857396-01, 

-3 . 7600096113639646*00, 
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5. 409 3 9507 19550 2 9e+00, 
-3. 52931384615150 2e+00, 
8 . 7  99 3  2 569  51 2284 5e-01  , 
-2.914074004278131ef00, 
3. 57414 507048 0903ev00. 
-2.2193838062395286400, 
5. 593946847263 199e-01, 
} ; 


/*  Coeffieients  for  filtered  noise  terms  */ 

/*  Order  is  numl-numD  &  denl-den2  for  the  inner  index  and  filterl- 
filter3  for  the  outer  Index  *f 

static  double  noise_coef f ( 3 J ( 5 ) = 

i 

?.0*’  =  67C251279C34g-02, 

4.171340502559269e-02, 

2.085670251279634e-02, 

-1.561018075800718e+00, 

6. 41351538057563 le-01, 

5.0636542768597336-03  , 

1. 0127308 5537 1947e-02, 

5. 063654 276859733e-03, 

-1.8226949251963086400, 

8.371816512560227e-01, 

0.0, 

-3- 3356054972737416-02, 

-2.4988494067873406-02, 

-1.74850014124294864-00, 

8 . 3404338237243686-01 

} ; 
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/' 


This  file  contains  transfer  function  data  for  rudder  inputs  only 


/*************** 

*  Source: 

*  Executable: 

*  Version: 

*  Date: 

*  Author: 

*  Project: 

*  Environment: 

*  Path: 

*  Description: 


*  Revisions: 


ii************************************************************* 

transfer.txt  * 
siroo  * 
1.5  * 
22  November  1989  * 
R.  W.  Scott  * 
Neural  Networks  in  Adaptive  Control  * 
UNlX/SunOS  C  * 
eileen: /home/rscott/nworks/textf iles  * 
This  is  the  header  file  used  to  define  the  variables  * 
used  in  the  USERIO  subprogram  simo.  This  allows  easy  * 
reconfiguration  of  the  executables  by  simply  changing  * 
information  in  the  header  file.  Inputs  include  altitudes,  * 
airspeeds,  the  sampling  time,  selected  frequencies  and  * 
and  weightings  for  a  sum  of  sine  waves  input,  labels  for  the  * 
inputs,  conditions,  and  states,  and  the  coefficients  for  the  * 
ni  merators  and  denominators  of  the  system  and  various  filters* 
used  to  generate  filtered  noise.  * 
--Inclusion  of  multiple  input  types  * 
--Running  the  sim  at  twice  the  speed  of  the  network  * 


h**********************«< 


i************************. 


/*  Altitudes  in  thousands  of  feet  */ 


static  double  altitude[5]= 

{ 

0.0,0.20,0.350,0.350,0.0 

>; 


/*  Mach  Numbers  */ 

static  double  mach(5]= 

{ 

0.4,0.638,0.5,0.7,0.85 

)  ; 

/*  Sampling  Time  */ 
static  double  ts={0.1}; 

/*  Frequencies  for  sum  of  sine  waves  input  */ 

static  double  freq(8]-{ 

0.005,0.09,0.11,0.65,1.5,2.75,3.0,10.0 

}  ; 


/*  Frequency  weighting  for  sum  of  sine  waves  input  */ 

static  double  weight(8]-{ 

2. 0,3. 0,2. 0,3. 0,2. 0,3. 0,2. 0,0. 5 

}  ; 

/*  Input,  condition,  state,  and  filter  labels  */ 

static  char  ‘input  name [ )  =  { " 1 1 lega 1  Input" , "Random  Binary", 

"Filtered  RB" , "Composite  Sine", "Swept  Square  Wave-Test  Only", 
"Composite  S im" , "Compos ite  Time"); 
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static  char  *contl  i  t  ion_nairo  [  ]  =  {  "  1 1 1  ega  1  Condition", 

"M  O.-i/SI/',  "M  0.638/20K",  "M  0.5/35K",  ”M  0.7/35",  "M  0.85/ 

static  char  * s ta te  namo ( ] " ( " 1 1 lega 1  State" , "Beta (t )", "p ( t )" , 

"r(t)",  "plii{t)"}; 

static  char  * f i 1  ter  name ( )  =  ( " 1 1 lega 1  Filter", ”0.5  Hz  co", 

"0.2  Hz  co","p  App  M  0.638/20K") ; 


/‘  Numerator  coef f icient.s  */ 

/‘  Order  is  bl -b4 , pi -p4 , r l-r4 , phi l-phl4  for  the  inner  indices  and 
Condition  1-Condition  5  for  the  outer  index  */ 
static  double  num  [  5  ]  [  4  ]  (  4  )  == 

{  1 . 800083273932040e-02 , 

-1. 90698424470685 5e -02, 

-1.0832241647Q3473C-02, 

1. 18963792029263 Oe -02, 

5. 005974 533658364e-02, 

-1. 55774632003 1326e-01, 

1.564735 69 75926 65e-01, 

-5. 07586830927 1 74 7e-02, 

-2. 94906875863 18 12e-02, 

8.355569801024743e-02, 

-7. 874 3980027954 57e-02, 

2. 465824 22 171 607 3e-02, 

1.1337017239121396-04, 

-1.3480515577057876-04, 

-1.040764174029540G-04, 

1.047840637068420e-04, 

1.282768174976745e-03, 

-1.453312059030765e-04, 

-5. 907 51062843 342 le-04, 

7. 61 1636927604 69 2e-04, 

4.570720462542699e-03, 

-1.42234 5894434773e-02, 

1.4305254700330476-02, 

-4.7325162185257736-03, 

-6.8941950941261436-03, 

1.9551698744578526-02, 

5.7696108468728866-03, 

-1.8428077553160456-02, 

6. 5984 30260407 184e-0 6, 

-7.778000894020920e-06, 

-6.1228572918459186-06, 

6. 3393833248381880-06, 

8 . 6506270343376106-03, 

-9.7325434849722116-03, 

-5.4762914191521796-03, 

6.5517658064017106-03, 

3.5231553501096526-02, 

1.1291628896646746-01, 

-3.802821756769237e-02, 

-6.8031438355361746-02, 

1.9906839925712426-01, 

-1.952861276856299e-01, 

6.3633371847224176-02, 

3.7578914361979806-04, 

-4.356397715552518e-04, 

-3.6438666883187316-04, 
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3.904802108620764e-04, 

1 , 3089145250355656-02 , 
-1.4245121411587296-02, 
-8.8624066001785636-03, 
1.0016301838316816-02, 

3 . 7228351703866296-02 , 
-1.1574941936493316-01, 

1 . 1637523938577006-01, 

-3 . 7854171724704296-02, 
-9.7437560385307266-03 , 
2.8426061232313956-02, 
-2.7632695359686386-02, 
8.9461021770779196-03, 
2.4222096731030266^05, 
-2.7879525874574546-05, 
-2.4078826362128326-05, 
2.3448275179971396-05, 
8.9543064175017236-02, 
-7.6860656167347946-02, 
-6.3105689291348196-02, 
5.0422679134579546-02, 

1 . 3817164022329116-01 , 
-4.4282010536370516-01, 
4.4327645256033216-01, 
-1.3862798741991776-01, 

-1 . 1504442014252716-01 , 
3.0479822258363596-01, 
-2.6591133400544556-01, 

7 . 6073495989607006-02 , 
2.5053117912321456-04, 
-2.0802498954175526-04, 
2.0386797406657396-04, 

); 

/*  Denominator  coefficients  */ 

/*  Order  is  denl-den4  for  the  inner 
for  the  outer  index  */ 
static  double  den[5][4]= 

{ 

-3.6175522645831126+00, 

5.0301111976312576+00, 

-3 . 1851335576713456+00, 

7 . 7259523210692646-01 , 

-3 . 7928221305612486+00, 
5.4206963168538996+00, 

-3. 457219170675306e+00, 
8.2934420910879306-01, 
-3.8996050533437396+00, 
5.7685250312145286+00, 
-3.8335554396438356+00, 

9. 646017 08 64308676-01, 

-3 . 7600096113639586+00, 
5.4093950719550116+00, 
-3.5293138451514856+00, 

8 . 7993256951227876-01 , 
-2.9140740042781346+00, 
3.5741450704809056+00, 
-2.219383806239528e+00, 
5.5939468472631986-01 
)  ; 


index  and  Condition  1-Condition  5 
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APPENDIX  B:  MATLAB  M-FILE 


%  CONTINUOUS  STATE  SPACE  TO  DISCRETE  TRANSFER  FUNCTION 
CONVERSION 

% 

%  Altitude  =  sea  level 
%  Mach#  =  .4 
%  u  =  446.6  fps 
% 

format  short  e 

%  Initial  plant  matrix 

a=[-.243  0.  -1.  .072;  -27.3  -1.699  .948  0.; 

14.9  .065  -.638  0.;  0.  1.  0.  0.] 

% 

%  Initial  control  matrix 
b=[0.;  16.526;  .0671;  OJ 
% 

%  Convert  b  from  radians  to  degrees 
b=b*pi/180; 

%  Compute  scaling  matrix  ’c’ 
c=eye(a);  d=[0  0  0  0]’; 
w=logspace(-3,2); 

[mag,phase]=bode(a,b,c,d,l,w); 

c=max(mag); 

x=[l, 1,1,1]; 

c=(x./c) 

c=diag{c); 

% 

%Balance  a,b,  and  c  matrices 
[ab,bb,cbj=obalreal(a,b,c); 

% 

%  Convert  to  discrete  time 
t=.l; 

[ad,bd]=c2d(ab,bb,t); 

% 

%  Convert  to  transfer  function 
f  NUM,DEN]=ss2tf(ad,bd,cb,d,  1 ) 
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APPENDIX  C:  CONTINUOUS  STATE  SPACE  EQUATIONS  AND  DISCRETE 
MATRIX  POLYNOMIALS  FOR  AN  AILERON  INPUT 


Sampling  Time  of  0. 1  Seconds 

FLIGHT  CONDITION  1 


Altitude  =  sea  level 
Mach#  =  .4 
u  =  446.6  fps 


a  = 

-2.4300e-001  0  -l.OOOOe+000  7.2000e-002 

-2.73(X)e+001  -1.6990e+0{)0  9.4800e-0()l  0 

1.4900e+001  6.5000e-002  -6.3800e-001  0 

0  l.OOOOe+000  0  0 


b  = 

0 

1.6526e+001 

6.7100e-002 

0 


NUM  = 

0  -9.3927e-005  1.1269e-004 
0  1.5617e-001  -4.3291e-001 
0  1.5113e-004  -2.9779e-004 
0  7.4350e-005  -6.148{)e-005 


8.8390e-005  -8.6428e-005 
4.1969e-001  -1.4295e-001 
1.7709e-004  -9.699  le-006 
-5.6458e-005  6.4316e-005 


DEN  = 

l.OOOOe-KXK)  -3.6176e-)-000  5.030 le-t-OOO  -3.1851e+000  7.7260e-001 
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FLIGHT  CONDITION  2 


Altitude  =  20,000  ft. 

Mach#  =  .638 
u  =  660  fps 
a  = 

-8.2900e-002  0  -l.OOOOe+000  4.8800e-002 

-4.5460e+000-1.6990e+000  1.7170e-001  0 

3.3820e+000  -6.5400e-002  -8.9300e-002  0 

0  l.OOOOe+000  0  0 


b  = 

0 

2.7276e+001 

3.9520e-001 

0 


NUM  = 

0  -1.2688e-004  2.6534e-004  4.3990e-005  -1.8149e-004 
0  1.5764e-001  -4.6480e-001  4.6208e-001  -1.5491e-001 
0  7.098 le-005  -2.3526e-004  2.5885e-004  -9.3603e-005 
0  1.4496e-005  -1.4546e-005  -1.2449e-005  1.3462e-005 


DEN  = 

l.OOOOe+OOO  -3.7928e+000  5.4207e+000  -3.4572e+000  8.2934e-001 
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FLIGHT  CONDITION  3 


Altitude  =  35,000  ft. 

Mach#  =  .5 
u  =  487  fps 
a  = 

-8.6400e-002  0 -l.OOOOe+000  6.6000e-002 

-9.0300e+000  -5.6200e-001  4.0400e-001  0 

6.5200e+000  -6.7600e-002  2.8800e-001  0 

0  l.OOOOe+000  0  0 

b  = 

-9.0000e-004 

5.4000e+000 

-7.5900e-001 

0 


NUM  = 

0  6.7298e-003  -5.1977e-003  -7.8547e-003  6.3014e-003 
0  1.0625e-001  -3.1592e-001  3.1871e-001  -1.0903e-001 
0  -1.4399e-002  4.1653e-002  -4.0071e-002  1.2851e-002 
0  3.2388e-004  -3.2184e-004  -2.9385e-004  3.2556e-004 


DEN  = 

l.OOOOe+000  -3.8996e+000  5.7685e+0()0  -3.8336e+000  9.6460e-001 
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FLIGHT  CONDITION  4 


Altitude  =  35,000  ft. 
Mach#  =  .7 
u  =  681  fps 


a  = 

-1.2210e-001  0 -l.OOOOe+000  4.7000e-002 

-2.2700e+001  -8.1900e-001  5.6000e-001  0 

1.1990e+001  3.3400e-002  -3.3800e-001  0 

0  l.OOOOe+000  0  0 

b  = 

0 

1.1770e+001 

-2.7500e-001 

0 

NUM  = 

0  3.5105e-004  -3.0166e-004  -3.5145e-004  3.0634e-004 
0  8.4703e-002  -2.4097c-001  2.3727e-001  -8.1003e-002 
0 -1.7916e-004  5.4941e-004  -5.5472e-0()4  1.8876e-004 
0  1.9515e-005  -1.7022e-005  -1.6357e-005  1.8152e-005 


DEN  = 

l.OOOOe+000  -3.7600e+000  5.4094e+(K)0  -3.5293e+000  8.7993e-001 
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FLIGHT  CONDITION  5 


Altitude  =  sea  level 
Mach#  =  .85 
u  =  950fps 
a  = 

-5.7500e-001  0 -l.OOOOe+000  3.40{){)e-002 

-1.1760e+(X)2  -3.8300e+000  1.9300e+{X)0  0 

6.8000e+001  4.5600e-002  -1.4040e+000  0 

0  l.OOOOe+000  0  0 


b  = 

0 

6.4400e+001 

5.0500e+000 

0 


NUM  = 

0  -7.7846e-003  5.7478e-003  7.0315e-003  -4.9l06e-003 

0  2.851  le-OOl  -6.1406e-001  5.5928e-001  -2.3033e-001 

0  3.0219e-003  -7.7494e-003  6.6269e-0{)3 -1.8154e-003 

0  6.7634e-005  -1.7857e-005  -1.4109e-005  4.8367e-005 


= 

l.OOOOe+000  -2.9141e+000  3.5741e+000  -2.2194e+000  5.5939e-00 
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APPENDIX  D:  CONTINUOUS  STATE  SPACE  EQUATIONS  AND  DISCRETE 
MATRIX  POLYNOMIALS  FOR  A  RUDDER  INPUT 

Sampling  time  of  0.1  seconds 
FLIGHT  CONDITION  1 
Altitude  =  sea  level 
Mach#  =  .4 
u  =  446.6  fps 


a  = 

-2.4300e-001  0  - 1  .OOOOe+OOO  7.2000e-002 

-2.7300e+001  - 1 .6990e+0{)0  9.4800e-001  0 

1.4900e+001  6.5000e-002  -6.3800e-001  0 

0  1. OOOOe+OOO  0  0 


b  = 

6.1785e-004 

1.2846e-001 

-1.1414e-001 

0 

NUM  = 

0  1.8001e-002  -1.907()e-002  -1.0832e-002  1.1896e-002 
0  5.0060e-002  -1.5577e-001  1.5647e-0()l  -5.0759e-002 
0  -2.9491e-002  8.3556e-002  -7.8744e-(X)2  2.4658e-002 
0  1.1337e-004  -1.348 le-004 -i.0408e -004  1.0478e-004 


DEN  = 

l.OOOOe+000  -3.6176e+000  5.0301e+000  -3.1851e+000  7.7260e-001 


FLIGHT  CONDITION  2 
Altitude  =  20,000  ft. 

Mach#  =  .638 
u  =  660  fps 
a  = 

-8.2900e-002  0  -l.OOOOe+000  4.8800e-002 

-4.5460e+000 -1.6990e+000  1.7170e-001  0 

3.3820e+000  -6.5400e-002  -8.9300e-002  0 

0  l.OOOOe+000  0  0 

b  = 

2.0246e-004 
1.0050e-002 
-2.377  le-002 
0 

NUM  = 

0  1.2828e-003  -1.4533e-003  -5.9075e-004  7.6116e-004 
0  4.5707e-003  -1.4223e-002  1.4385e-002  -4.7325e-003 
0  -6.8942e-003  1.9552e-002  -1.8428e-002  5.7696e-003 
0  6.5984e-006  -7.7780e-006  -6.1229e-006  6.3394e-006 


DEN  = 

l.OOOOe-t-000  -3.7928e-t-000  5.4207e+000  -3.4572e-t-000  8.2934e-001 
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FLIGHT  CONDITION  3 
Altitude  =  35,000  ft. 

Mach#  =  .5 
u  =  487  fps 
a  = 

-8.6400e-002  0 -l.OOOOe+000  6.6000e-002 

-9.0300e+000  -5.6200e-001  4.0400e-001  0 

6.5200e+000  -6.7600e-002  2.8800e-001  0 

0  l.OOOOe+000  0  0 

b  = 

2.6128e-004 

3.9270e-002 

-4.7298e-002 

0 

NUM  = 

0  8.6506e-003  -9.7325e-003  -5.4763e-003  6.5518e-003 
0  3.5232e-002  -1.1012e-001  1.1292e-001  -3.8028e-002 
0  -6.8031e-002  1.9967e-001  -1.9529e-001  6.3633e-002 
0  3.7579e-004  -4.3564e-004  -3.6439e-004  3.9048e-004 


DEN  = 

l.OOOOe+000  -3.8996e-K)00  5.7685e+000  -3.8336e+000  9.6460e-001 
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FLIGHT  CONDITION  4 


Altitude  =  35,000  ft. 

Mach#  =  .7 
u  =  681  fps 
a  = 

-1.2210e-001  0 -l.OOOOe+000  4.7000e-002 

-2.2700e+001  -8.1900e-001  5.6000e-001  0 

1.1990e+001  3.3400e-002  -3.3800e-001  0 

0  l.OOOOe+000  0  0 

b  = 

3.6128e-004 

9.1979e-002 

-8.4648e-002 

0 

NUM  = 

0  1.3089e-002  -1.4245e-002  -8.8624e-003  1.0016e-002 
0  3.7228e-002  -1.1575e-001  1.1638e-001  -3.7854e-002 
0  -9.7438e-003  2.8426e-002  -2.7633e-002  8.9461e-003 
0  2.4222e-005  -2.7880e-005  -2.4079e-005  2.3448e-005 


DEN  = 

l.OOOOe+000  -3.7600e+000  5.4094e+000  -3.5293e+000  8.7993e-001 
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FLIGHT  CONDITION  5 


Altitude  =  sea  level 
Mach#  =  .85 
u  =  950  fps 
a  = 

-5.7500e-001  0 -l.OOOOe+000  3.4000e-002 

-1.1760e+002  -3.8300e+000  1.9300e+{){)0  0 

6.8000e+001  4.5600e-(X)2  -1.4040e+000  0 

0  l.OOOOe+000  0  0 

b  = 

1.5673e-003 

6.4577e-001 

-4.7298e-001 

0 

NUM  = 

0  8.9543e-002  -7.6861e-002  -6.3106e-002  5.0423e-002 

0  1.3817e-001  -4.4282e-001  4.4328e-001  -1.3863e-001 

0  -1.1504e-001  3.0480e-001  -2.659  le-001  7.6073e-002 

0  2.5053e-004  -3.3041e-004  -2.0802e-004  2.0387e-004 


DEN  = 

l.OOOOe+OOO  -2.9141e-K000  3.5741e+0(X)  -2.2194e+000  5.5939e-001 
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